Scaling Out the Performance of Service Monitoring Applications with BlockMon

نویسندگان

  • Davide Simoncelli
  • Maurizio Dusi
  • Francesco Gringoli
  • Saverio Niccolini
چکیده

To cope with real-time data analysis as the amount of data being exchanged over the network increases, an idea is to re-design algorithms originally implemented on the monitoring probe to work in a distributed manner over a stream-processing platform. In this paper we show preliminary performance analysis of a Twitter trending algorithm when running over BlockMon, an open-source monitoring platform which we extended to run distributed data-analytics algorithms: we show that it performs up to 23.5x and 34.2x faster on BlockMon than on Storm and Apache S4 respectively, two emerging stream-processing platforms.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Blockmon: Flexible and High-Performance Big Data Stream Analytics Platform and its Use Cases

This paper describes Blockmon, a novel, configurable, software-based Big Data platform for high-performance data stream analytics. Its design allows running applications for a wide range of use cases. When used as network data processing and monitoring platform, it copes with 10 Gb/s of continuous traffic, up to layer 7 (e.g., DPI), on a single commodity server. When used as a server-log proces...

متن کامل

Phase II monitoring of multivariate simple linear profiles with estimated parameters

In some applications of statistical process monitoring, a quality characteristic can be characterized by linear regression relationships between several response variables and one explanatory variable, which is referred to as a “multivariate simple linear profile.” It is usually assumed that the process parameters are known in Phase II. However, in most applications, this assumption is viola...

متن کامل

پایش پروفایل با پاسخ چند رسته ای اسمی

In certain statistical process control applications, quality of a process or product can be characterized by a function between response variable and one or more independent variables. This function commonly referred to as profile. Response variable can be continuous or discrete. All of the research assumes that the response variable is continuous. Whereas, some of the potential applications of...

متن کامل

New phase II control chart for monitoring ordinal contingency table based processes

In some statistical process monitoring applications, quality of a process or product is described by more than one ordinal factors called ordinal multivariate process. To show the relationship between these factors, an ordinal contingency table is used and modeled with ordinal log-linear model. In this paper, a new control charts based on ordinal-normal statistic is developed to monitor the ord...

متن کامل

Online Monitoring and Fault Diagnosis of Multivariate-attribute Process Mean Using Neural Networks and Discriminant Analysis Technique

In some statistical process control applications, the process data are not Normally distributed and characterized by the combination of both variable and attributes quality characteristics. Despite different methods which are proposed separately for monitoring multivariate and multi-attribute processes, only few methods are available in the literature for monitoring multivariate-attribute proce...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013